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ABSTRACT 

Procedures for designing piecewi se- linear (PWL) switching surfaces 
for minimum time control are investigated. The approach is to generate 
the switching function using the instantaneous values of the states as 
inputs to easily realized PWL function generators. The design problem 
is then one of fitting the state space PWL surface to points defining 
the optimal surface. 

Several performance indices related to minimum-time are defined 
and the resulting parameter surfaces for different initial condition 
distributions are studied. However, because of local minima, a success- 
ful search procedure could not be found. Therefore, a heuristic method 
of least squares fitting is used. A combination gradient and general- 
ized Newton-Raphson search method is employed to obtain values for the 
PWL parameters. Several least squares fit methods are applied to a 
second order problem and the results compared using response time per- 
formance to a uniform grid of initial conditions. Very close to optimal 
performance is achieved using a delay time design procedure. 
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1. INTRODUCTION 



This study is concerned with the specific problem of minimum-time 
control of a linear, instantaneous, time invariant plant described by n 
first order linear, constant coefficient differential equation 

(1.1) x = Ax + Bu 

where 

x is an nxl state vector, 

A is a known nxn plant matrix, 

u is the scalar plant control which is bounded, 

B is a known nxl distribution matrix of the control u. 

The plant is restricted to having a transfer function which contains no 
zeros and only real and negative eigenvalues. In addition, the n states 
must be measureable. 

The object of this study is to develop a general design procedure 
for an easily "rea 1 i zab 1 e” controller such that the desired minimum time 
control of the plant can be effected. A block diagram of the system is 
shown in Figure 1. 




Figure 1. Block Diagram of Plant and Controller 
The differential equation of the plant can be normalized with respect 
to the magnitude of the control u, such that I u I f: 1. The control u is 
determined by the scalar switching function, <T , such that u = sgn CT. 
The above system can represent either (a) the so-called ’’regulator” 
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problem where the input c is zero and the plant must be forced in minimum 
time from some non-zero, random, initial condition state to the state 
space origin, or (b) the general control problem where the input function 
c is non-zero, but restricted to an allowable class of f unct ions, e . g . 
step or ramp for a second order plant. This implies that the input can 
be imbedded and treated as an initial condition of the error state vec- 
tor or more easily visualized as a translation of the state space origin 
to the desired point in state space e.g. a position or velocity con- 
trolled system. Again the purpose of the controller is to generate the 
proper scalar <T so as to force the plant from its initial state to the 
desired state in minimum time. 

Since there is a preponderance of literature on this subject of 
minimum time control, a one paragraph condensation of previous work will 
be attempted by giving only the most significant contributions and those 
which directly affect this study. Historically, the minimum-time regu- 
lator problem (for bounded control, constant-coefficient, second and 
third order plants) was first studied by McDonald Cl], followed by 
Bogner and Kazda [2], and Bushaw [3]- Bellman, Glicksbury and Gross [4] 
established the following important results: 

1. The optimum control law is bang-bang, i.e. minimum time response 
is achieved if the magnitude of the control u is always at its maximum 
value, |u| = 1. 

2. For any initial condition in the state space, the state origin 
will be reached in minimum time with, at most, (n-1) reversals of the 
control u. This result applies to any constant-coefficient n t ^ L -order 
plant provided the plant eigenvalues are real and negative. 

The maximum principle of Pontryagin [5] also shows that the control u 
should always be at its maximum value. For the case where the plant 
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transfer function has zeros in the left-half plane, Schmidt [6] has shown 
that (n-1) reversals are still required but the optimum solution is not 
bang-bang. The distinction must be made that this result is not for the 
criteria of returning the state vector x to zero in minimum time but 
rather returning the plant output and its derivatives to zero in minimum 
t ime . 

Previous results of optimal controller design can be divided into two 
classes; those using a digital computer as the controller with the com- 
puter programmed to rapidly compute the required cr as a function of 
time using the differential equations of the plant and the specific 
initial condition given, <T = fCx^t), [7,8]; or those using some elect- 
ronic device that computes the required (T as a function of the instan- 
taneous states, which implies that the states must be available for feed- 
back. The first approach has more often been used, however, it requires 
an on-line digital computer. The second approach is more feasible but 
has not been widely used because of the complexity of the optimal switch- 
ing function. This function cannot, in general, be expressed in closed 
form for third or higher order plants. [9] It should be noted that this 
optimal switching function, for higher than second order plants, defines 
a switching surface in state space where this curved surface partitions 
the space into a u = +1 region and a u = -1 region. Because this 
switching function has such a complicated dependence on the states, the 
emphasis in controller design has been on quasi-opt imal controllers 
which are more easily implemented but give less than optimal perfor- 
mance. [10,11] 

As shown in Figure 1, this study will use the second method of com- 
puting the control as a function of the states and then realizing a 
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controller that is quas i-opt imal . The method, to be developed in Section 
2, uses piecewise-linear functions of the state variables to generate the 
quasi-opt imal switching function. Section 3 gives a phase plane plot 
analysis of the effect of a PWL switching line. The difficulties en- 
countered using an actual response time performance index are discussed 
in Section 4, compared to the non-response time indices discussed in 
Section 5. Section 6 gives the multi-dimensional cost surface iteration 
search procedure which is used. The concluding Sections apply the devel- 
oped methods to 2nd and 3rd order system examples. 
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2. STATEMENT OF THE PROBLEM 



The minimum-time optimal switching surface which divides the state 
space into u = +1 and u = -1 regions can be defined by the optimal 
switching function 

(2.1) c r* = f*(x) = 0 

where the * denotes optimal- Since this function cannot, in general, 
be expressed in closed form for an n t ^ 1 order system, an alternative is 
required to define the surface. Smith [l l] has used a reverse time sim- 
ulation of the differential equations of the plant wherein the simulated 
plant is started at the origin, numerical integration is performed with 
time-running backward, and the sign of the control u is switched n-2 
times. The result is a set of points describing one-half the optimal 
switching surface i.e. the locus of one-half of all trajectories which 
takes the plant to the state space origin in (n-2) or fewer switching 
of the control u. The one-half comes about since there are two terminal 
trajectories that take the plant to the origin without a change of u, 
one with u = +1 and the other with u = -1. It can be shown that since 
the plant is linear and the control u is symmetrical, the optimal switch- 
ing surface is an odd function of the state variables and therefore only 
one-half of the surface need be generated. It is assumed that the ex- 
pected maximum values of the states of the plant are known a priori such 
that a boundary for each state may be assigned. Hence, the optimal sur- 
face is bounded and the number of points describing the surface is finite. 

In addition to the restrictions placed on the plant in Section 1, a 
further requirement is that the optimal switching surface must be single 
valued in at least one state. Smith has shown, using Jordan canon- 
ical form, that for a linear plant with real eigenvalues, the time- 
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optimal surface is single valued in the ’’uncoupled” states, e.g. described 
by a differential equation that is independent of the other states. For 
this study, let be this ’’uncoupled” state variable hereafter called 
the independent state variable. The optimal switching surface can now 
be defined by 

(2.2) (T* = f*(xj) p + (x i ) p =0 for j = 1,2, ...n 

3 * i 

p = 1,2, ...P 

where 

P = total number of points defining one-half the optimal 
switching surface 

p = index of P points 
Xj = dependent states 
x^ = independent state 

The object in this study is to somehow fit the optimal switching 
surface (points) given by (2.2) with a piece-wise linear (hereafter PWL) 
surface described by an array of weights W as shown in Figure 2. 







Figure 2 . General PWL Switching Function 
Although the PWL equations may be written in several different forms, 
the break point to break point form was chosen because of the ease of 
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digital implementation. Letting be the number of segments per de- 
pendent state variable, and K the number of weights per dependent state 
variable, then K = 2 + 2 since each additional segment beyond the first 

is defined by two additional weights. The total number of segments is 
y^(n-l) and the total number of weights is K(n-l). The set of weights 
can be arranged as an array of numbers with no algebraic properties. 



(2.3) 


f( W l,l) 


(“1.2) 


W l,3 


• * * W 1,K-1 


II 


( W 2 , l) 


("2, 2) 


«2,3 


’ ’ • W 2,K-1 










W j,k 




( W n-l,l) 


K-1,2) 


W n-1, 


3 W n-1,K- 



(“i.kI' 



j / i 

k= 1 , 2 , . . . K 
K=2 n + 2 



With the PWL surface so formulated, W - u with k„„_ refers to x. value 

J > * even j 

of the break point with W- , being the corresponding x- value of the 

J y 1 J 

break point, where £ j refers to the PWL function generator output for 
x_. input. Certain of the weights indicated by parenthesis are assumed 
to be held fixed by the formulation of the problem, e.g. (W ■ and 
(Wj 2 ) are determined by the desired origin neighborhood to be discussed 
in Section 4, and (w j ^ by the x boundary. Therefore, the number of 
variable weights p equals the total weights minus the fixed weights, 

Q = (n-l)(2)^ -1). Thus, the design procedure must provide values for 
^ variable parameters such that the PWL surface is by some criterion 
fitted to the optimal surface. 

Although this study is aimed at realization of the controller, the 
emphasis will be on the required design procedures using digital compu- 
ter simulation. However, the actual PWL switching functions can be 
easily realized using resistors, diodes, and betteries as shown in Fig- 



ure 3. The W. 



. . values are the battery voltages and the W. , ,, 

j,k even J 6 J,k odd 
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values are determined by the various resistor combinations. For example 



in Figure 3, if x • is between W- h and W • diodes (a) and (b) are con- 
J J 5 ^ J ) D 

ducting and current is flowing through R Q and R^ ; thus 



(2.4) 



= -Rf 



(± + _L\ Xi + + 

K R i / J f \ R o R i / 



Figure 3a shows a PWL function generator for = 4 and Xj ^ 0. An equi- 
valent network with reversed diodes and batteries is required for x j — 0. 





(c) Controller, 3rd-0rder Plant 
Figure 3: Realization of PWL Switching Functions 

The PWL switching function, where the symbol A denotes PWL, cannot 
be expressed explicitly in terms of W but rather in terms of the PWL 
function generator output x^: 
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n 



(2.5) 



T = 0 = f(x,W) = - 




or 



n 



( 2 . 6 ) 




j=l 

j/i 



Thus, the controller, as shown in Figure 3c, can be simply realized. 
The basic question which remains and which is the heart of this 



of the optimal surface so as to achieve minimum-time trajectories. Two 
approaches are possible; (1) a brute force, straightforward technique of 
setting the parameters so as to minimize the actual response times to a 
typical set of initial conditions as discussed in Section 4; or (2) 
defining some other non-response time performance index as discussed in 
Section 5. 

In order to investigate the problem as stated, some type of compu- 
ter simulation is required. A digital model has been used throughout 
this study, rather than an analog or hybrid model, simply because of 
the number of calculations required. Appendix A contains the digital 
model and the computer programs. 



paper is how to fit the PWL surface with p variables to the P points 
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3. EFFECT OF A PWL SWITCHING SURFACE 



In order to better understand the non-linearities produced by PWL 
switching, a qualitative study will be made of a second-order, double 
integrator (1/s ) plant. The state equations of this plant can be ex- 
pressed as a function of the state variables x^ and *2 , and control u. 
The resulting two first-order differential equations are: 

*1 = x 2 

(3.1) 

X 2 = u, where for minimum time control u = ± 1 
These equations can be solved using conventional methods in terms of a 
specific initial state, x (t Q ), 

for u = -1 x 1 (t f ) = + tx 2 (t Q ) - %t 2 

(3.2) x 2 (t f ) = x 2 (t 0 ) - t 

and for u = +1 x^(t^) = x^(t 0 ) + tx 2 (t Q ) + 



x 2 ( t f) = x 2 (t 0 ) + t 

For different initial states, the possible trajectories in the two- 
dimensional state space are two families of parabolas as shown in 
Figure 4a and 4b and given by 



(3.3) 



for u = -1 



and for u = +1 



-1 


X 1 = _ ^ x 2 2 


+ c 


+1 


Xj = +%x 2 2 


+ c 





Figure 4. l/s z Plant State Space Trajectories 
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Using Pontryagin’s maximum principle, the well known minimum-time trajec- 
tories to force the states from some random state to the origin are the 
partial parabolas as shown in Figure 4c. The optimal switching surface, 
or line in this case, is the trajectory passing through the origin with 
n-2 = 0 switchings which is (3.3) with = C 2 = 0. 

If this optimal switching line is now replaced by a PWL switching 
line, what does a typical trajectory look like? The answer is that at 
each intersection of a trajectory with the PWL line, the possibility 
exists that relay chatter or after-end point action (hereafter called 
bumping) will occur. First, consider the one segment PWL line (OC) in 
Figure 5a where the segment divides the two families of parabolas. This 
is the familar linear switching problem as obtained with tachometer 
feedback . 




Figure 5. 1/s ^ Plant PWL Switching Trajectories 

It can be seen from Figure 5a that for each possible segment whose slope 
crosses (at point B) the optimal line, some member of the u = +1 family 
will be tangent to the segment (at point A). Thus, any u = -1 trajectory 
which intersects the PWL segment: 

(1) Between points 0 and A will bump down to point 0. 
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(2) Between points A and B will move with u = +1 to some place 
between points 0 and A and then bump, 

(3) Between B and C will move with u = +1 past the origin. 

(4) Exactly at point B will move with u = +1 to the origin (optimal). 
For the general case with several segments, Figure 5b, similar bumping 
action occurs. Any u = -1 trajectory, which intersects a PWL segment 

at a point closer to the origin than the tangency point (A, C or E) , 
will bump until the slope is changed by the next segment (points B and 
D) . For example, a u = -1 trajectory intersecting at point E, will bump 

down to point D, move on a u = +1 path and either pass point B or inter- 
sect the BD segment between C and B and bump down to B, and again move 

on a u = +1 path past the origin. Therefore, for a large number of ran- 

dom initial conditions, approximately one-half of the trajectories will 
bump upon the first intersection with the PWL switching line. The re- 
sults are easily extended to higher order systems where the FWL surface 
again crosses the optimal surface at least once per segment. 

Although this result is in itself trivial, it does point out the 
PWL switching non-linearities which make impossible any mathematical 
optimization of the general n^-order, PWL, true minimum response-time 
problem. Furthermore, since this bumping is so frequent with PWL 
switching (without other modifications), care must be taken in modeling 
this system to insure that the bump time of the model accurately repre- 
sents that of the actual relay or contactor. For example, the bump time 
of a digital computer design model is dependent on the integration step 
size; or for an ideal relay simulation, somehow recognizing when bump 
is occurring and changing to an (n-1) set of non-linear differential 
equations dependent on the segment slope. The equation of the latter 
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y 

case for the several segment 1/s plant can be solved in terms of the 
bump time, t^ : 



(3.4) 



t b = 1/b log 



a + b Xj(t f ) ~1 

- a + b x 1 (t Q ) J 



where 

t^ = ideal relay bump time to move from x^ (t ) to 
x^Ctf) along a segment 

b = the slope of the segment 

a = the X 2 intercept of the segment 

For higher order systems, however, the equations become very complex. 

It is realized that bump or continuous rapid changing of the con- 
trol is not tolerable in many physical systems. One procedure to be 
discussed in Section 7 does eliminate this undesirable feature. 
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4. RESPONSE TIME PERFORMANCE INDICES 



In order to quantitatively evaluate the operation of any particular 
controller, a scalar performance criterion or cost, denoted by J, is 
defined whose value depends on the particular setting of the variable 
parameters. The problem of fitting P optimum points with a PWL function 
of p variables then reduces to finding the minimum value of J, i.e. 
searching a performance surface in a p + 1 dimensional space for the 
global minimum of J. To obtain minimum time performance, minimize 

0 f 

(4.1) J = \ dt = t f - t 0 

Ao 

This is the time to go from some initial state x(t Q ) to some final state 
x(tf), which, for this problem, is the state space origin. However, 
since the FWL surface crosses the optimal surface several times, depend- 
ing on the number of segments, more than several initial conditions are 
required to adequately define the fitting of the two surfaces. In 
effect, the fit of the two surfaces is optimized only for the initial 
conditions used in evaluating the cost function. Thus, the general con- 
tours and specific minimums of the cost surface are both a function of 
the variable parameters and a function of the number and distribution 
of the initial conditions. Since there are no established criteria for 
such an index, several different cost functions were studied: 



M 



= — > 

M 

m=l 



m 



M 



(4.2) 



Jo = — 
2 M 



m=l 



<*« - v 



M 

J3‘4r2Trt m -0 2 

m=l 
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1 ) 




M 



M 



M 





m= 1 



where 



M = total number of initial conditions considered 



m = index of initial conditions (m = 1,2,....M) 





optimal response time for the m th initial condition, x^t ) 

PWL response time for the m^ initial condition and a given 
PWL surface 



The true average optimal response time for M initial conditions can then 
be given in terms of and of (4.2) 



Each of the five definitions in (4.2) provide a different weight for 
the distribution of the initial conditions, and hence, a different glo- 
bal minimum for a given set of initial conditions. For example, 
gives the most weight to those initial conditions which have the largest 

A 

t, i.e. the ones starting farthest from the origin; J 2 and J 3 also give 
more weight to those farthest from the origin but have the advantage 
over J 3 of at least indicating how close to the optimal is the PWL; 
and give equal weight to each initial condition and would seem to be 
the most desirable. Also, the squaring in and J 5 gives more weight 

• ^ 1 

to the larger deviations between t and t and results in a smoother cost 
function. However, any choice of one over the other four is arbitrary. 
Thus, it will be left as a designer’s choice according to the particular 
problem being solved, i.e. the expected distribution of the actual initial 




M 



(4.3) 




m= 1 
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conditions. Having once obtained t and t* for a particular initial 
condition, it is an easy matter to compute all five of the cost func- 
tions and hence, all five will be compared in this paper. Appendix A 
contains subroutine ’’COSTS" which computes the five cost funct ionsgiven 
by (4.2) using subroutines "OPTRT" and "PWLRT" which compute t* and t* 
respectively for a given initial condition. 

As an introductory study of the minimum-time cost surfaces, the 
1/s^ plant described in Section 3 was chosen using a one segment ( r l) 
PWL surface. The points (P = 14) used to define the optimal switching 
surface were generated at .1 second intervals by integrating backwards 
in time from the origin. Before proceeding, several seemingly arbitrary 
decisions must be made. First, since it is not possible in an engineer- 
ing sense to reduce the states to exactly zero using the FWL scheme, 
some origin neighborhood must be defined. For this preliminary study, 
a tear shaped origin neighborhood was used, whose boundaries are trans- 
verse trajectories, equation (3.3). Secondly, since both states are 
uncoupled and single valued, either state could be chosen as the in- 
dependent state, therefore let x^ = . The boundary for the dependent 

state was then selected at x^ = 1. The third arbitrary decision in- 
volves choosing the number and distribution in state space of the initial 
conditions. As a first attempt, it was considered desirable to have 
initial conditions spaced away from either of the two surfaces, say on 
the x^ axis, and also to have each initial condition affect an equal 
number of P points. Hence, the initial conditions were generated by 
choosing every third point defining the optimal surface and then inte- 
grating from these points backward in time until intersection with the 
x^ axis occurred. The resulting four initial conditions were x^ = .09, 
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.36, .81 and 1.44; X 2 = 0. Figure 6 shows the fourth quadrant of the 

state plane with the four initial conditions, the optimal trajectories 

and the origin neighborhood. Also shown in Figure 6 are four possible 

segment slopes with weights: W-, , = W = 0 ; W = -1.667, -2.222 , 

J-jJ- 1,2 1,3 

-3.333, -6.667 and ^ = 1, where the slopes pass through the optimal 
switching line at the four corresponding trajectory intersections. 




Figure 6 : Second Order Example 

Since the cost functions for this simple problem are only two di- 
mensional, J can be easily plotted as a function of the one variable 
weight, W^ 3 - Using the digital model shown in Appendix A and an inte- 
gration step size of .0001 seconds, the optimal and FWL (with variable 
Wi 3 ) response times for the four initial conditions were computed. 
Figure 7 shows the resulting cost surfaces for the five cost functions 
defined by (4.2). The relative magnitudes of J are unimportant. How- 
ever, the shapes of the surfaces, specifically the multi-inflection 
points (local minimums) , present a very difficult problem for cost 
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functions of greater than two dimensions, i.e. more than one variable 
parameter. The task of searching such a multi-parameter surface in the 
presence of noise (or local minimums) is an area of current investiga- 
tion. However, other than a completely random search procedure, no 
successful method has yet been developed. [l2] 

Using the above second-order example with revisions, the following 
results were obtained. First, a one- init ial-condit ion problem has a 
cost function with more than one minimum. In fact, it has a minimum at 
each weight (segment slope) which results in an optimal switching for 
a given number of half revolutions around the origin. Four initial 
conditions resulted in more than eight minimums, with one occurring 
at each of the four weights shown in Figure 6. Fourteen and twenty-four 
initial conditions were also tried. The result was that the general 
shape of the cost surface became more linear as the number of initial 
conditions were increased but also, the number of local minimums greatly 
increased and were more closely spaced, although not individually as 
deep. Thus, several conclusions are: (a) the number and distribution 
of initial conditions directly affects the number and spacing of the 
cost function local minimums, (b) a cost function minimum exists at 
each weight which makes a particular initial condition trajectory op- 
timum, (c) using a large number of initial conditions does not eliminate 
the local minimums but rather increases them, and (d) the general shape 
of the cost surface does improve as the number of initial conditions is 
increased. Hence, it seems feasible that an iteration procedure could 
be developed with a large enough step size so as to "step over" the 
closely spaced minimum provided enough initial conditions were used. 
However, the difficulty for such a multi-parameter search now becomes 
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one of excessive computer time in evaluating the response times for each 
perturbation of the search. 

In an attempt to improve the shape of the cost surface, several of 
the arbitrary decisions previously made were modified in turn. Several 
origin neighborhood shapes were studied including circle, square and 
diamond. The only conclusion reached was that the transverse trajectory 
size of the neighborhood had a direct effect on the width of each mini- 
mum, i.e. a larger neighborhood resulted in a wider minimum, but in no 
way changed the general shape of the cost surface. Secondly, x^ was 
made the independent variable, but again, no significant change in re- 
sults were noted. 

Frederick ElCf) has studied the same general problem as above with 
the restriction that the variable parameters of the PWL switching func- 
tion be limited to a small number so that the cost surface may be ran- 
domly searched. Methods are given for selecting the initial conditions 
such that a searchable cost surface is obtained. Also, root-locus 
techniques are given for designing linear (one segment per dependent 
state) switching functions in order to initiate the search of the cost 
surface and to then determine which of the components should be made 
PWL. However, the methods are not adaptable to a multi-parameter prob- 
lem because of the dimensionality and local minima of the cost surface. 

Thus, since the problem as stated in Section 2 cannot be readily 
solved by the direct approach of minimizing the response times of a 
random set of initial conditions, a heuristic method was used. 
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5. NON-RESPONSE TIME PERFORMANCE INDICES 



The problem of fitting for minimum response time the P optimum 
surface points with a PWL surface of p variables can be indirectly 
solved if the performance criteria or cost index is defined such that 
the resulting p dimensional cost surface can be successfully searched. 
The previous section showed the local minima difficulties which arise 
when the cost index is given as a function of the response times for a 
random distribution of initial conditions. This section will define 
two other indices which are independent of actual response times since 
they both use the common least squares fitting technique. Hopefully, 
these indices will result in setting the p parameters of the PWL sur- 
face for minimum response times. However, since the true optimal PWL 
parameters cannot be easily found per Section 4, the use of either of 
these least squares fit indices to design the controller must be justi- 
fied by the actual response time performance (4.2) of the resulting con- 
troller. 

Smith [l3l defined a least squares fit (LSF) index which in the 
notation of this paper, is 

(5.D j 6 = ^ [<*i> p - (*r> p ] 2 

where x^ is given by (2.6). 

In words, this is the sum for P optimal surface points of the square of 
the difference between the optimal surface (point) and the PWL surface, 
measured in terms of the independent state, i.e. the square of the x^ 
distance between the two surfaces measured from each P point. Substi- 
tuting in (5.1) for x^ yields 
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(5.2) 



2 




3*i 



For the one-segment example of Section 4, the cost surface obtained with 

(5.2) has a smooth parabolic shape. One other advantage of using the 
LSF index is the elimination of the arbitrary decisions concerning the 
origin neighborhood shape and the number and distribution of the initial 
conditions. Hence, the solution for p parameters is unique if given 
only the P points, the boundaries, the independent state, and the number 
of segments. Appendix A contains subroutine "SUMSQ" which computes the 
cost given by (5.2). 

Using the index of (5.2), Smith [l3j developed a non-iterative 
analytic method to fit the P point optimal surface with a PWL surface 
of %( p + 1) parameters. With reference to Figure 2, Smiths 1 method 
uses fixed break points, i.e. Wj^ even are fixed at values which are 
evenly spaced between the origin and the boundary. The remaining 
%( p +1) weights are found by defining %( p + 1) linear-segment non- 
linearities which are functions of the dependent states. The weights 
are then calculated using matrix algebra. The method, as developed by 
Smith, will be used in this study (see computer subroutine "STARTW" 
in Appendix A) to obtain the starting weights for the parameter surface 
search procedure to be developed in the next section. 

A second possible LSF index is that of using ’’deviation time”, 

? t > defined as the transverse trajectory time spacing between the opti- 
mal and the PWL surfaces. The cost function is given by: 

P 

(5.3) J 7 = X ( & 

p=l 
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This deviation time can be found by using the appropriate sign of control 
u, and integrating with forward or backward time from each P point until 
intersection with the PWL surface. If the cost function (5.3) is to be 
evaluated a large number of times, such as in an iteration search method, 
it would be easier, rather than integrating each time, to define a grid 
of points on each side of the optimal surface where the points are spaced 
a given number of time increments apart. Figure 8, using the 1/s^ plant, 
shows such a grid in which there are two points on each side of each op- 
timal surface point. 




The deviation time can then be rapidly approximated by counting the 
number of increments between the optimal surface point and the FWL 
surface and interpolating for the last partial increment. The method 
of using deviation time is easily extended to higher-order systems and 
would, at first glance, appear to give a better LSF in terms of actual 
response time. The cost surface obtained with (5.3), for the one seg- 
ment example of Section 4, has a skewed parabolic shape. Appendix A 
contains subroutine "OPTGRID” which generates a grid of points on each 
side of the optimal surface and subroutine ,T DEVT” which computes the 
cost given by (5.3). 
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6 . SEARCH PROCEDURE FOR MULT I -DIMENSIONAL COST SURFACE 



The task of searching a multi-dimensional cost surface would be very 
difficult for a surface containing local minima. However, by using either 
of the least squares fit indices of Section 5, a relatively smooth para- 
bolic shaped surface is obtained. Hence, a generalized Newton-Raphson 
iteration procedure has been developed which has the advantage of rapid 
convergence. 

The cost index J (J^ or J 7 ) is assumed to be a function of p para- 
meters, , W 2 5 W^, . . . . where each parameter is one of the variable 

weights Wj k gi- ven by equation (2.3). J is then approximated by a Taylor 
series expansion in the W space where W is a ^ x 1 column matrix of the 
variable weights. The expansion is terminated with the second order terms 
of the Taylor series and is performed about the point W° which is a ^ x 1 
column matrix of the starting values of the ^ weights. For the first 
iteration, W° is obtained by Smiths analytical method of fixed break 
points as discussed in Section 5. For the following iterations, is 
the w’ value of the preceeding iteration. The expansion is: 



(6.1) 



J(W) = J(W°) + 




(W-W°) 



%(W-W°) 






W°) 



where 



fejl T _ J a J J_3 

)awjV fawi aw 2 



ao 






1 X 

1 st 



p matrix of 
part ials 



and 








d 2 J 

a w x aw 2 



j 2 j 
<}w 2 2 
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therefore 



= V = ? x ? 



matrix of 2nd partials 



(6.2) J(W) = J(V^) + (r) 7 ^ (W-tf>) + ^(W-W°) T Q w o (W-W°) 

The procedure is to first evaluate J(W°) using (5.2) or (5.3), then per- 
turb W enough times to generate enough equations so that £ and Q can be 
determined . 

If the variables are perturbed by a small increment & , one at a 
time (i = 1,2,. . . . jo ) , where Wj_ is the i t ^ 1 component of W, then letting 



W i+ = W? + A and = W? - A 

each pair of perturbations produces, from (6.2), two equations 

(6.3) J(W. + ) = J(W°) + rj_ (W i+ - W?) + 1 ' 2 q ii (W. + - W?) 2 

= J(v/ D ) + A + 

and J(W._) = J(W°) - A r i + ^ A 2 q u 
These two simultaneous equations can then be solved for r^ and q^ 



yielding 



(6.4) r £ = _L_ [j(W i + ) - J(W t _)] 

q ii = -Jj- j^J(W i + ) + J(W t _) - 2J(W°)j 



Thus if J(W°) is known, and if each variable is perturbed by + A and 
- A and the corresponding two costs evaluated, the r vector and the 
diagonal terms of Q can be evaluated from (6.4). This is so far a total 
of 2 p perturbations. Next the q ^ ^ cross partial terms must be evaluated. 
From physical considerations, it is obvious that Q is a symmetric matrix, 
i.e. q.:^ = q- • , and hence only one-half of the cross partial terms need 
be calculated. If each pair of two variables is perturbed by + A , then 
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substituting in (6.2) yields: 



(6.5) J(W i+ + Wj + ) = J (W°) + r L (W i+ - W° ) + r j( W j + ~ w j ) 

+ ^iiCWi - w«) + jj(Wj - w?) + q ij (w i - w^XWj - w?) 

This equation can be solved for q— since the r terms and the q^ terms 
were previously found by (6.4). Rearranging (6.5) 



( 6 . 6 ) 



■Uj * V - *<!?>] 




+ r . 
J 



■ % f q ii * q :j] 



To find all the q— terms, — ( p- 1) perturbations are required. Hence, 

p 

the total perturbations required to find £ and Qis2^+-((i-l) = 

£ <p* ». 



The new weights can now be calculated by differentiating (6.2) with 
respect to W, setting the resulting equation equal to zero, and solving 
for the new weights, W . 



(6 ' 7) - £ + Q<w' - W°) = £ 

(6.8) W’ = W° - Q _1 r 

For the scalar case ( £> = 1), equation (6.8) reduces to the familar 
Newton-Raphson iterative equation 



(6.9) 



w' = w° - 



dj 

dW 

d 2 J 

dW 2 



Figure 9a shows the scalar case Newton-Raphson procedure wherein the 
object is to find the value of W for which J = f(W) is at an extreme 
point, in this case a minimum. The necessary and sufficient conditions 
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for J to be at a minimum extreme point are that ^ = 0 and - j > 0. 

dW dw 2 

The Newton-Raphson procedure is as follows: 

1. obtain a starting value of the variable = V° 

2. approximate d J with a straight line which is tangent to 

dW dW 



at the point W° 

3. find the value of W = w' where the tangent line intersects 

= 0 
dW 

4. repeat steps 2 and 3 using w’ as the new W° until = 0. 

dW 

Equations (6.8) and (6.9) are steps 2 and 3 for the generalized p variable 
and the scalar ( p = 1) cases respectively. 





Figure 9. Scalar Newton-Raphson Iterative Procedure 

To insure convergence of the Newton-Raphson method, the cost surface 

must be of convex shape, e.g.^L- ^>0 for the scalar case, or similarily, 

dVT 

the starting weights W° must be within this convex region as shown in 
Figure 9b. For the case where W° is near the permissible Newton-Raphson 
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JfT 

boundaries, e. g ..iLJi posit ive but near zero, a slight modification of the 
dW 2 

procedure is required. Equation (6.8) for the general case can be re- 
written 



(6.10) w' = W° - K Q -1 r 

where K is a scaling factor (0^ K^l). Hence, at the end of each itera- 
tion, let K = 1, find w' from (6.10), compute J(w' ) and compare it with 
J(W°). If J(w’) is greater than J(W°), let K be less than one and con- 
tinue to repeat the above i.e. a single variable K search procedure (see 
Section 9), until the optimum step size (within 1%) is found. At the end 
of the iterative process (convergence), each element of £ will be zero if 
J (W f ) is at an extreme point, and Q will be a positive definite matrix if 
J(w') is at a minimum extreme point. Appendix A contains subroutine 
"FITW" which, given an initial W° , will iterate to a minimum in J using 
(6.4) , (6.6) and (6.10). 
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7. COMPARISON OF SEVERAL PWL DESIGN PROCEDURES FOR 1/s 2 PLANT 

The results of the previous sections will be combined and used in 
this section in developing and evaluating several possible PWL design 
procedures for a simple second-order plant with three PWL segments. The 
general design method will be to fit the PVL surface to the P points of 
the optimal surface using one of the LSF indices and the generalized 
Newton-Raphson search procedure. Having thus designed the controller, 
its performance will then be evaluated by comparing it to other possible 
controllers including the true optimum. 

In order to measure the performance of any particular controller de- 
sign, the response time indices given by (4.2) will be computed using a 
fixed set of initial conditions. Smith [l3] chose the P points of the 
optimal surface as the set of initial conditions and computed only the 
Jj index. A more accurate measure of performance would be the response 
times of a complete grid of initial conditions having uniform distribu- 
tion and covering the entire state space out to the selected boundaries. 
Because of symmetry, only one-half of state space need be used. This 
method would better test the entire PWL surface and would more closely 
approach the design objective of a completely random distribution of 
initial conditions. Subroutine "RECGRID" of Appendix A generates this 
grid of points in the state half space. For the purposes of this section, 
through J 5 given by (4.2) will be computed for both initial condition 
distributions, in order to note the different quantitive results obtained. 

For comparison of different controller design methods, the 1/s^ plant 
discussed in Section 3 was chosen with boundaries at |x^| = 1.125 and 

|x 2 j = 1.5. The optimal switching line passes through opposite corners 
of this boundary. An integration step size of 0.01 seconds was used, and 
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the optimal line was defined by 15 points spaced 0.1 seconds apart. Each 
design method was performed twice, using either the J 6 or indices. 

To evaluate the performance of each design method, the response time in- 
dices were computed for both the 15 initial condition points defining 
the optimal surface and for 90 initial condition points uniformly distrib- 
uted in the state half space. The origin neighborhood used was again of 
tear shape, having cross trajectory boundaries, equation (3.3) with 
C l = c 2 = 0.01. 

The several methods employed with their corresponding subroutine 
calling arguments are as follows: 

(1) A one segment PWL surface, ( p = 1), fitted to the P optimum 
points with the generalized Newton-Raphson search procedure or equivalent- 
ly, Smith’s method Ql3]. (GALL OPTSUR, STARTW, COSTS, RECGRID, COSTS). 

(2) A three segment PWL surface with fixed break points, (^= 3), 
fitted with either of the two, for this case, equivalent methods. (CALL 
OPTSUR, STARTW, COSTS, RECGRID, COSTS). 

(3) A three segment PWL surface with variable break points, 

( p = 5) , fitted with the Newton-Raphson search. (CALL OPTSUR, STARTW, 
FITW, COSTS, RECGRID, COSTS). 

(4) Same as (3) above except that the 5 PWL parameters were 
fitted by plotting, i.e. better guess. 

(5) Same as (3) above except that in computing the response 
time performance the feedback loop was opened such that only one switch 
was allowed per state space quadrant. (MODIFY SUBROUTINE FWLRT) . 

(6) Same as (3) above except that the P optimal points were 
shifted .06 seconds backward on the transverse trajectory before being 
fitted; and in computing the response time performance, the switching of 



36 



the relay was in each instance delayed .06 seconds. (CALL OPTSUR, FITW, 
DELAY, FITW, COSTS, RECGRID, COSTS, ALSO MODIFY SUBROUTINE PWLRT) . 

Figure 10 is a table of the design weights and the response time perfor- 
mance costs. Method 1 was included in order to show the advantages of 
PWL switching over standard linear switching. Method 2 is the present 
published ’’state of the art” [] 1 3 J - Method 3 shows the degree of improve- 
ment obtained by using variable break points and the iterative procedure. 
Method 4, which is not adaptable to higher order systems, shows that the 
best possible FWL fit has not been obtained using the LSF indices. Method 
5 is also not adaptable to higher order systems but it does indicate the 
close to optimal performance that can be obtained when the relay chatter 
(bump) is eliminated. Method 6 yields the best results, again by elimi- 
nating the bump. Its adaptability to higher-order systems and realiza- 
tion will be discussed in the next section. 

A study of the data in Figure 10 would suggest the following comments 
and conclusions: 

( 1 ) versus J y : 

In method 1, gives a better fit than J y for the optimum sur- 
face initial conditions (I.C.'s) whereas Jy is better than for the 

uniform grid of I.C.’s. In methods 2 and 3, gives a better fit for both 
initial condition distributions. In the remaining methods, there is no 
comparison between and Jy because of the differences between through 
J^. Hence, the conclusion is that and Jy give roughly the same re- 
sults. However, since is much easier to compute (digitally faster), 
it is preferred over the more difficult Jy . 

(2) Comparing through J 5 : 

There is no apparent ’’goodness” of any one over the four since 
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each provides similar information although weighting the individual res- 
ponse times differently. As stated in Section 4, it will be left as a 
designer's choice depending on the expected distribution of actual initial 
conditions. As a personal choice, will be used in the remainder of 
this study because it gives equal weight to each initial condition and 
inherently includes the comparison with the true optimal i.e. = 1 says 
that for a given initial condition, the expected value of t m will be twice 
that of t*. 

(3) Optimum surface initial conditions versus the uniform grid initial 

conditions: From Figure 10, using the optimum surface initial conditions, 

the costs for method (1) with one segment appear better than method (2) 
with three segments, which is obviously incorrect. The error comes about 
because all the optimum surface points (I.C.'s) which are closer to the 
origin than the first PWL segment intersection, are already beyond the 

PWL switching and hence are optimum. On this basis, it is concluded that 
the uniform grid of initial conditions better tests the entire PWL switch- 
ing surface. 

(4) Comparison of the five methods yields the following conclusions: 

a. PWL switching is better than linear switching. 

b. Optimizing the break points is better than arbitrary break 

points . 

c. The LSF indices do not provide the best response time PWL 

fit. 

d. Eliminating the bump or relay chatter produces very near 
optimal performance. 
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l/j 2 PLANT 

Beundariea: |xi|aal.l?5» N =1 - 



DESIGN 



M£THOLG 


WEIGHTS 




Fit 

Index 


(Paranthacia indicatea fixad) 


w i^ 


*14 




*16 


W 17 


*18 


1. linear 
seguanta 

n»i 

m 


J 6 


- 1 . 9^5 


(1.125) 










J 7 


-’.559 


(1.125) 


2. fixed 

break pta 

n-3 

? x3 


J 6 


- 1.020 


(0.375) 


-1.204 


(0.750) 


- 1.551 


(1.125) 


J 7 


- 1.032 


(0.575) 


-1.190 


(0.750) 


- 1.516 


(1.125) 


/. variable 
break pts 

n=3 


J 6 




o.ei 2 


-0.956 


0.456 


- 1.528 


(1.125) 


J 7 


- 0.314 


0.312 


-0.648 


0.330 


- 1 . 5^3 


(1.125) 


^ e same as 
5« abova 


graph- 

ical 


- 0.450 


0.063 


-0.680 


0.400 


- 1.530 


(1.125) 


5* earra aa 

Je abova 
with open 
loop 


J 6 


- 0.456 


0.612 


-0.956 


O .436 


- 1.528 


(1.125) 


J 7 


- 0.314 


O .312 


-0.648 


O. 35 O 


- 1 . 5^5 


(1.125) 


6. aama as 

5. above 
with delay 
t ima 


J 6 


-0.257 


O .526 


-0.797 


0.387 


-1.404 


(1.125) 


J 7 


- 0.256 


0.055 


-0.736 


0.556 


-1.416 


(1.125) 



LEGEND: 

Non-Responae Time Indices: 




L j\i J 

FIGURE 1C. Result? of Second Order PWL Switching 
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FIGURE 10. Continued 
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J 4 


J 5 


1 . 


J 6 
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1.074 


1.546 


0.647 
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J 7 


1.225 


0.609 


1.259 


1.054 


0.400 


2.955 


0.945 


1.222 


0.555 


0.445 


2. 


J 6 


I 1.217 


0.605 


0.802 


0.955 


0.472 


2.905 


0.896 


1.056 


0.492 


O.56O 


J 7 


| 1.242 


0.629 


0.872 


0.999 


0.496 


2.915 


0.905 


1.086 


0.495 


0.576 


5. 


J 6 


0.895 


0.281 


0.109 


0.405 


0.257 


2.524 


0.515 


0.119 


0.186 


0.074 


J 7 


1 0.926 


0.512 


0.125 


O.605 


0.590 


2.540 


0.550 


0.151 


0.196 


0.077 


4. 


grap- 

hical 


j 0.054 


0.240 


0.079 


0.547 


0.225 


2.290 


0.292 


0.104 


0.175 


0.066 


5. 


J 6 


0.727 


0.115 


0.042 


0.246 


0.045 


2.095 


0.087 


0.062 


0.056 


o,o4i 


J 7 


0.705 


0.089 


0.051 


0.548 


0.052 


2.105 


0.095 


0.045 


0.051 


0.052 


6. 


J 6 


0.791 


0.112 


0.045 


0.290 


0.011 


2.071 


0.065 


0.056 


0.052 


O.015 


J 7 


0.006 


0.140 


O.O56 


0.209 


0.059 


2.056 


0.054 


0.049 


0.048 


0.022 



LEGEND: 
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8. GENERAL DESIGN METHOD 



The previous section indicated the desirable results obtained with 
a PWL switching function and the delay time method of eliminating the 
bump. The generalization of this method is explained in this section and 
a possible delay time switching circuit is given. The general delay time 
design procedure for a plant of order n is as follows: 

a. Generate the P points defining the optimal switching surface by 
starting at the origin, integrating the state equations with reverse 

time and switching the control n-2 times. This requires defining a bound- 
ary (maximum expected value) for each of the states, an integration step 
size and the time spacing between the P points. Subroutine "OPTSUR" in 
Appendix A generates the P points. 

b. Fit the P points of the optimal surface with a PWL surface of p 
variables using a least squares fit cost index (J^ given by equation 
5.2) and an iterative procedure (Newton-Raphson , equation 6.10) to search 
the cost surface. It requires choosing an independent (single valued) 
state and the number of PWL segments per dependent state. Subroutine 
”FITW" i n Appendix A fits by least squares the PWL surface to the optimal 
surface points, i.e. finds values for ^ variables. 

c. Find the maximum deviation time, ( £ t^max* between the optimal 
surface and the PWL surface by integrating from each P point, with for- 
ward or reverse time, along the transverse trajectory until intersection 
with the PWL surface. 

d. Shift each of the optimal surface points 2(S t ) max units, back- 
ward in time along its transverse trajectory. Subroutine "DELAY” in 
Appendix A computes ( S t^max and shifts the P optimal surface points. 

e. Refit the P points of the shifted optimal surface with a var- 
iable PWL surface as in step b. but without changing the independent state 
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or the number of segments. 

f. Realize the controller with (n-1) PWL function generators, Figure 
3, using the ^ weights of step e. Also use a contactor or relay with an 
inherent delay of 2(£ t^tnax’ i-* e - switches the control u at 2( $ t ) max 
time units after the scalar switching function < 7 “ passes through zero. 

The above can be most easily visualized in the two dimensional state 
space by the 1/s^ example of Section 3. Shown in Figure 11 are the P 
points of the optimal line, the PWL fit, the maximum deviation time 
( S t^max and the shifted P points. The ( i t>max t ^- me units on each side 
of the original optimal line defines a swath 2($ t ) max time units wide 
within which most trajectories will remain after the first switch. How- 
ever, note that the boundaries of the swath do not define trajectories 
but rather in moving toward the origin the swath tends to get closer to 
the optimal whereas the trajectories tend to diverge. Hence, not all 
trajectories will remain in the swath after the first switch. If each 
P point of the optimal line is shifted backward in time, 2( £ t^ ma x un ^ ts 
along its transverse trajectory, a second swath is obtained. Now, if 
the switching function ar goes through zero in the shifted swath (at the 
PWL surface which has been fitted to the shifted P points) and if the 
actual relay switching is delayed 2(6 t .)_ , then the actual switching 

will occur in the original swath. Thus, the objective of eliminating 
the bump will be completely achieved for all trajectories remaining in 
the swath and partially achieved for those leaving the swath. 

The delay time method requires a relay that switches the control u 
a fixed time after the switching function <r goes through zero. One 
awkward but workable device to accomplish this is shown in Figure 12 
using three relays and an RC changing circuit. Whenever T passes 
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Figure 11. Delay Time Method 



#3 




Figure 12. Delay Time Switching Circuit 
through zero, relay 1 switches and charges capacitor C with a D.C. volt- 
age t V which in turn energizes relay 2 and opens the input to relay 3. 
This relay 3 with feedback has the overall characteristic shown in Figure 
12 where, in this case, the constant K is just large enough such that it 
does not switch when relay 1 does. The RC discharge time and the drop 
out current of relay 2 determines the delay time as shown in Figure 12. 
Hence, at the end of the delay time, relay 2 closes and since c~ is now 
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greater than K, relay 3 switches the control u. The above time delay 
switching could probably be more elaborately done with digital circuitry 
using a Schmidt trigger arrangement. However, the above is satisfactory 
for indicating the realization of time delay switching. 

The results of using the proposed time delay method are indicated in 
the table of Section 7 for the second order plant. For all intents and 
purposes, the response times achieved with PWL switching and delay time 
are within some origin neighborhood of the true optimal. The next section 
will attempt to apply the proposed method to a third-order example. 
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9. THIRD ORDER EXAMPLE 

The previous section defined the general design procedure which 
will be applied in this section to a triple integrator (1/s^) plant. 
The state equations for this plant are: 

*1 = x 2 

(9.1) x 2 ~ x 3 

x^ = u where u = t 1 

The time optimal switching surface for forcing the states to zero from 
any initial condition can be expressed in closed form Q 4 J as: 

k X 1 x 3 3/2 

(9.2) (T = 0 = X 1 + — + C x 2 x 3 + + £ x 2 ^ 



where 



6= sgn 



Xo + 



l x 3 1 



The resulting surface is singled valued in all three states and is sym- 
metrical about the state space origin since the control u is symmetrical 

The design objective for this example will be to approximate the 
optimal surface with a PWL surface of four segments ( = 4) per depen- 
dent state, within the region bounded by jx^j ^ 36, Jx ^ j 18, x^| ^ 6. 

From Section 2, the number of variable weights is P = (n-l)(2 ^ -1) = 14 
The other rather arbitrary choices are: let x^ be the independent state 

let the integration step size be 0.1 seconds and let the time spacing 
between the optimal surface points be 1 second. Using Subroutine 
M 0PTSUR” in Appendix A, the optimal half surface is then defined by 
30 points. 

The second step outlined in the procedure of Section 8 is to now 
search the P + 1 = 15 dimensional space for the minimum LSF cost as 
given by equation (5.2). The search procedure is the generalized Newton 
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Raphson iterative method of Section 6. However, because some of the 
initial values W 3 of the 14 variables are apparently not within the 
allowable Newton-Raphson range (see Figure 9), the method was found 
not to converge. Also, because there exists such a complicated relation- 
ship between the variable weights, the cost surface was found to contain 
many irregularities i.e. inflection points, saddle points, etc, which 
hindered the search. 

Since Smith's method (J 1 3 J is the only reasonable starting point 
for W°, a different starting search procedure is required. Using equa- 
tion (6.4) for r ( p x 1 matrix of first partials), a gradient or 
steepest descent method can be defined as: 

(9.3) W* = if + Kr 

where K is a constant defining the step size. 

The difficulty with the gradient method is in choosing a proper K since 
too small a step will result in a very slow descent (many iterations) 
and too large a value could result in an increasing cost (an ascent) or 
an overlapping of the PWL break points. One possible definition for 
the step size is: 




where AJ = J(w’ ) - J(W°) = the change in cost desired which is defined 
a priori (before the step) . 

For the purpose of this study, each computation of £ will be con- 
sidered as one gradient iteration. Then, for each gradient iteration, 
a single variable search procedure was developed to find the value of 
K which minimized J(w'). The reasons being that J(W ? ) was found to vary 
significantly with the choice of K and secondly each gradient iteration 
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requires 2p (28 in the third order example) computations of the cost 
versus one computation for one value of K. Each gradient iteration is 
then analogous to determining the direction of steepest descent r from 
some point W° and then moving in this direction until no further descent 
is possible without changing directions. The single variable search 
procedure is as follows: 

1. Compute the starting value of K from (9.4) with A J equal to 
one per cent of the preceeding J(w'). 

2. Compute w’ from (9.3) and the resulting J(w’ ). 

3. a. If J( W* ) < J(W°) , let J(W°) = J (W’ ) , and repeat step 2. 

b. or if J(w’) > J(W°), let K = -.IK, J(W°) = J(W'), and repeat 

step 2. 

The process is continued for three reductions of K, i.e. K increasing 
in increments of 1, decreasing in increments of .1, and increasing in 
increments of .01, such that the final value of K is within one per 
cent of the optimal value. 

The above gradient method was tried on the p = 14, third-order 
problem, but again because of the many irregularities of the cost sur- 
face, the method did not converge after numerous iterations, although 
each iteration did result in an improvement. A final modification was 
that of a hybrid search where the gradient method was used for start- 
ing. After each gradient iteration, the (self second p^rtials) were 

computed, and if all q— were positive (a necessary but not sufficient 
condition for Q to be positive definite), then the search automatically 
switched to the Newton-Raphson method given in Section 6. This hybrid 
method also failed because the test of Q for going to Newton-Raphson 
was not sufficient to insure the step was in the proper direction i.e. 
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Q positive definite. 

The two questions of whether or not some other iterative search 
procedure can locate the global minimum of J (fit the PWL surface) in 
a reasonable amount of computer time and whether or not the delay time 
method of eliminating the bump is adaptable to third and higher-order 
systems will be the subject of further study. 
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10. CONCLUSIONS AND ACKNOWLEDGEMENTS 



The problem of designing an easily realizable minimum time (bang- 
bang) controller was investigated. The approach was to realize the 
switching function by using the instantaneous values of the states as 
inputs to piecewise linear function generators. The problem then re- 
duces to finding the optimal weights for the piecewise linear functions 
i.e. fitting the FVL surface to the optimal surface. 

A qualitative study of the effect of PWL switching showed the un- 
desirable but very prevalent relay chatter (after end point action) 
which results. Several minimum time performance indices were defined 
and the resulting performance surfaces for different initial condition 
distributions were studied. The conclusion reached was that because 
of local minima, the global minimum of these performance surfaces could 
not be readily found. Therefore, a heuristic design method was re- 
quired, namely, least squares fitting. The search of the least squares 
performance surfaces, for the multi-dimensional, second-order case, 
converged quite rapidly using a generalized Newton-Raphson iterative 
proced ure . 

Several different design methods for a second-order plant were 
studied, including: linear switching, arbitrarily fixed PWL break 

points [13], variable break points, and delay time. It was concluded 
that PWL switching is better than linear switching, that variable break 
points is better than fixed break points, and that delay time is very 
near the true optimal since it eliminates the relay chatter difficulty. 
This comparison of methods was based on actual response time performance 
to a uniform grid of initial conditions. It was also concluded that a 
uniform grid of initial conditions in the state space better tested the 
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performance of a PWL switching surface than did an optimum surface grid. 

The variable break point and delay time methods were then applied 
to a third order plant with fourteen PWL variables. The Newton-Raphson 
procedure for fitting the PWL surface would not converge because of the 
starting values of the parameters. The use of a gradient (steepest 
descent) method was also tried but did not converge after numerous 
iterations although each iteration did result in an improvement. 

The problems for further study are numerous. Among the most impor- 
tant are a search procedure which converges in a reasonable time for 
third and higher-order plants and a method (perhaps delay time) which 
eliminates the relay chatter for third and higher-order plants. There 
are many facets of this eliminating the bump problem which have not 
been fully investigated in this paper. One seemingly easier approach 
than delay time would be that of switching on some constant cr value 

as shown for relay #3 (with feedback) of Figure 12. For the second- 
's 

order case, the constant loci are translations of the (T = 0 (PWL) 
line in the independent state direction. However, for a third-order 
system, the information for the second switch from the optimal surface 
to the optimal line would seem to be lost. Another interesting problem 
that could be studied is the relationship between the desired origin 
neighborhood size and the minimum number of P VL segments required to 
avoid overshooting the neighborhood. It would appear that the width 
of the maximum deviation time swath around the origin would define a 
desirable origin neighborhood size and hence indirectly relate the num- 
ber of segments required for a given origin neighborhood. Other refine- 
ments include: using linear combinations of the states to produce cross 

product terms (curved PWL surfaces) [l3j; and possibly, some other sur- 
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face fit criteria. A close to optimal general problem solution would 
be of considerable interest since it would help bridge the gap between 
optimal theory and optimal practice. 

The author would like to express his appreciation for the guidance, 
assistance and encouragement of Professor D. E. Kirk under whose direc- 
tion this study was performed. In addition, thanks are due to the 
author’s fellow graduate students for many helpful discussions. 
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SECTION 7 FOR VARIOUS METHODS) 
CALL OPTSUR 
CALL STARTW 
CALL OPTGRID 
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SIGN=C0NTR0L TO PLANT=+1 OR-1 
I NC=NUMBER OF DT STEPS BETWEEN XD(J) POINTS 
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CALL RKUT ( IC »S IG* I NC ) 
PRINT 301 *M» (XD( J ) ♦ J=1 *3 ) 
301 FORMAT (/,2X, I 4 ♦ 5X * 3E 1 5 . A ) 



X( J,M)=XD( J) 

I F ( ABSF ( X ( J * M ) ) —BP ( J ) )5,3.8 
CONTINUE 
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PURPOSE TO OBTAIN STARTING VALUES OF THE PWL WEIGHTS W(J,K) BY 

EVENLY SPACING THE BREAK POINTS ( K EVEN) AND ANALYTICALLY FINDING 
BY LEAST SQUARES (SMITHS METHOD) THE K ODD VALUES. REQUIRES 
SUBROUTINE GAUSS 3 FOR MATRIX INVERSION (ON LIBRARY TAPE). 
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U) W 1 ( M A ) = W I I MA ) ♦ Q ( M A . M A ) «R ( M.O 



DO 31 J = 1 * N 
IF ( J-L >32,31,32 
DO 33 K=1,NU 
MA = MA+ 1 
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DW = WE I GHT INCREMENT PER EACH PERTURBATION 

DR= ALLOW ABL E DEVIATION FROM ZERO OF SUM OF SQUARES OF THE C IRST PART I AL S 
D I R = AC TUAL DEVIATION P ROM Z t- RO AFTER EACH ITERATION 
R =COLUMN MATRIX OF FIRST RART : ALS* M(N-l) 

Q = SOU AR E MATRIX OF SECOND PART[ALS. M ( N - 1 ) X M ( N- 1 ) 
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END 
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XD ( J ) = X ( J ♦ I ) 



CALL PWLP05 ( SE65 .XX ) 



C, 

or 

e 



Lf. 



D 

C 

to 



Lu 

VJ 

< 

Ll 

CY 

3 

tO 



5 

a 

Li 

c 
























— 














tO 








































X 














o 














— 




X 






















X 














UJ 






— 








r-H 




O 






















•• 


r- •< 












uO 














| 


























to 


♦ 












1 






< 












♦ 






















t D 


3 












to 






1 








— 




CM 




















— * 


UJ 


i — i 












o 






< 


cm 








»— 


•— * 




lT> 






CM 










2 : 


tO 


«► 








vO 




UJ 








* 






— 


3 


r — * 




» 












CM 




•> 




CM 








♦ 




to 






* 


* 






0 


O 


» 
















| 


-ZL 


3 


to 


— 








h- 




h- 






in 


O 






0 




X 




» 








to 




*— « 


♦ 


3 


o 


to 








♦ 










• 


to 






f— H 


» 


CM 










<r 


o 






r-H 


— 


CL 


o 








r- 




X 






+ 


— 






* 


O' 


» 




— » 






V 


UJ 




★ 


II 


X 


-J 


UJ 


UJ 




ro 






tO 








+ 


UJ 




1— 


O 


X 




to 






n 


to 






3 


II 




to 


3 


r-H 


r-H 


• 




o 






u 


2 : 


3 


X 




(NJ 






O 




• 


3 


II 




+ 


3 




a 


* 


Z 


+ 




rvj 


CM 


UJ 


• 




+ 


3 


2! 


3 


— 




1— 




UJ 




<-H 




to 




3 




3 




< 


• — ■ 


i— 


o 


1 


1 


to 


CM 


< 


• 


tO 


— < 


tO 


II 


1— 


< 




tO 


cm 


1 


r-H 


o 




+ 


o 


3 




a 


l— 




1— 


< 


X 


I— 


1 




r-H 


II 


h- 


ll 


y— 


z: 


X 




— 


ll 


II 




Ll’ 


3 








-j 


— 


e 


ii 




*■— 


li 


II 


< 


II 


It 


X 




O 


3 


*— r 


oc 


0 


Ll 


< 


< 


O 


tO 


II 


ll 


o 


0 


< 


Ll 


O 


i— 


o 


Ll 


< 




II 




o 


3 


O 


3 


O 


(X 


0 


z 




v: 


a 


O 


1— 


< 


x 


o 


X 


LJ 


— 1 


u 




o 


*— < 


2 : 


u 


<1 


< 


Ul 


tO 


u 


< 




Cl 


Ll 


UJ 




-j- 




in 










o 






r-H 






cm 


sO 


n- 




m 






3 








O' 





vO 

CM 



69 



SUBROUTINE DELAY 

DIMENSION X ( S . 1000 ) . XD( S ) .W ( 5, ?0 ) ,BP ( 5 ) . ID( 6 ) 
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CALL PWLPOS(SEGS»XX ) 
I F ( SEGS ) 5 * 6 ♦ 2 
I C = 2 
GO TO 7 
I C= 1 
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SUBROUTINE RECGRID 

DIMENSION X(5»1000),XD(5),W(S,->0),BP(S),ID(6) 
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X ( J ♦ K ) = GR I D OF POINTS FOR J=l,\' < = 1»ID 

I D ( I ) = I NDFXOF XI J.KI POINTS Foo ]=?,N+1(1 ASSOCIATrn wjth SIGN) 
OTHER INPUT/OUTPUT 

T OP T =0P T I MUM RESPONSE TI^F FOP < T H INITIAL CONDITION 
T T = PWL RESPONSF TIME FOP 0“ INITIAL CONDIM'X 



200 FORMAT ( /// »2X»A3HRESPONSE TIMFS FOR EACH INITIAL CONDITION 
1 */ ,2X,A0HINDEX OPT RESPONSE PWL RESPONSE ) 
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PURPOSE TO CALCULATE THE OPTIMUM RESPONSE TIME T FOR INITIAL 
CONDITION X ( J »M ) • REQUIRES SUBROUTINE RKUT • 
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